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IN THE CLAIMS: 

The text of all pending claims, (including withdrawn claims) is set forth below. Cancelled 
and not entered claims are indicated with claim number and status only. The claims as listed 
below show added text with underlining and deleted text with str i k e through . The status of each 
claim is indicated with one of (original), (currently amended), (cancelled), (withdrawn), (new), 
(previously presented), or (not entered). 

Please AMEND claims 19, 22-31, 33-37, 61, 64, 67-76, 78-82, 109, 112-118, 120, 121 
and 123-127, CANCEL claims 1-18, 20, 39-60, 62, 63, 65, 84-108, 110, 119, and 129-135 in 
accordance with the following: 

1-18. (CANCELLED) 

19. (CURRENTLY AMENDED) A control system for controlling a display device 
including a display unit displaying a motion picture, and a pointing unit pointing a position on the 
motion picture, said control system comprising: 

a recognizing unit recognizing an object in the motion picture on which the pointing 
manipulation is effected: and 

a processing unit executing a predetermined process related to the object recognized, 
where said processing unit, 

wherein said processing unit, when the object is recognized from the pointing 
manipulation during the display of the motion picture contained in the first data, commands said 
display device to effect a first changeover to an output of the second data related to the object, 
said processing unit commands said display device to execute a second changeover to display 
the motion picture after outputting the second data, and 

A control system according to c l aim 18, wh e r ei n said display device further includes a 
recording unit recording data, and said processing unit, after outputting the second data, issues 
a command of displaying the motion picture from a point of the first changeover recorded on 
said recording unit. 

20. (CANCELLED) 

21 . (PREVIOUSLY PRESENTED) A control system for controlling a display device 
including a display unit displaying a motion picture, and a pointing unit pointing a position on the 


2 


Serial No. 09/955,059 

motion picture, said control system comprising: 

a communication unit transmitting the position on the motion picture receiving the 
pointing manipulation to a server including a unit recognizing an object in the motion picture 
receiving the pointing manipulation, and receiving, from said server, information on the object in 
the motion picture recognized by said server; and 

a processing unit executing a predetermined process related to the object recognized. 

22. (CURRENTLY AMENDED) A -The control system according to claim 21 , wherein 
said display device further includes a receiving unit receiving data, 

wherein said receiving unit receives first data containing the motion picture, and second 
data related to the object in the motion picture contained in the first data, and 

said processing unit makes said display device output the second data related to the 
object recognized. 

23. (CURRENTLY AMENDED) A -The control system according to claim 22, wherein 
the second data contains an image related to the motion picture of the first data. 

24. (CURRENTLY AMENDED) A -The control system according to claim 22, wherein 
the second data is multiplexed with the first data and thus distributed. 

25. (CURRENTLY AMENDED) A -The control system according to claim 24, wherein 
the first data is constructed with a predetermined data structure and t he second data is 
embedded in a margin formed in the data structure of th e first data . 

26. (CURRENTLY AMENDED) A -The control system according to claim 21 , wherein 
said processing unit executes an application program related to the object recognized. 

27. (CURRENTLY AMENDED) A -The control system according to claim 21 , wherein 
said processing unit executes a task related to the object recognized. 

28. (CURRENTLY AMENDED) A The control system according to claim 21 , wherein 
said processing unit commands other task executing device to execute a task related to the 
object recognized via said communication unit. 
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29. (CURRENTLY AMENDED) A contro l syst e m accord i ng to c l a i m 21 , A control 
system for controlling a display device including a display unit displaying a motion picture, and a 
pointing unit pointing a position on the motion picture, said control system comprising: 

a communication unit transmitting the position on the motion picture receiving the 
pointing manipulation to a server including a unit recognizing an object in the motion picture 
receiving the pointing manipulation, and receiving, from said server information on the object in 
the motion picture recognized by said server; and 

a processing unit executing a predetermined process related to the object recognized, 

and 

wherein said display device includes a reproducing unit reproducing the motion picture 
recorded on a recording medium, 

said recording medium is recorded with a first motion picture and a second image related 
to an object corresponding to the first motion picture, and 

said processing unit makes said reproducing unit reproduce from said recording medium 
the second image related to the object recognized and makes said display device display the 
reproduced second image. 

30. (CURRENTLY AMENDED) A The control system according to claim 21 , wherein 
said server further includes a unit transmitting an information to an add-up device adding up the 
pieces of information, and 

said processing unit notifies said server of the information on the object recognized via 
said communication unit, and makes said add-up device add up results of the recognition via 
said server. 

31 . (CURRENTLY AMENDED) A -The control system according to claim 21 , wherein 
said display device further includes a reproducing unit reproducing the motion picture recorded 
on recording medium, and 

said communication unit , when the motion picture to be reproduced receives the 
pointing manipulation, transmits, to said server, information for specifying this motion picture and 
information for specifying a position where the pointing manipulation is effected on the motion 
picture. 
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32. (CURRENTLY AMENDED) A server in linkage with a display device including a 
receiving unit receiving data containing a motion picture, a display unit displaying the motion 
picture, and a pointing unit pointing a position on the motion picture, said server comprising: 

a communication unit receiving information on the position where the pointing 
manipulation is effected from said display device; 

a recognizing unit recognizing the object in the motion picture receiving the pointing 
manipulation on the basis of the information received from said display device; and 

a processing unit executing a predetermined process related to the object recognized . 

33. (CURRENTLY AMENDED) A -The server according to claim 32, wherein said 
processing unit transmits the information on the object recognized to said display device via said 
communication unit. 

34. (CURRENTLY AMENDED) A -The server according to claim 32, wherein said 
processing unit executes a task related to the object recognized. 

35. (CURRENTLY AMENDED) A The server according to claim 32, wherein said 
processing unit, via said communication unit, commands other task executing device to execute 
a task related to the object recognized. 

36. (CURRENTLY AMENDED) A rThe server according to claim 32, wherein said 
communication unit notifies an add-up server adding up pieces of information, of the information 
on the object recognized, and makes said add-up server add up results of the recognition. 

37. (CURRENTLY AMENDED) A -The server according to claim 32, wherein said 
communication unit communicates with an E-mail server delivering an E-mail, and 

said processing unit, via said communication unit, commands said E-mail server to 
deliver an E-mail related to the object recognized. 

38 (CURRENTLY AMENDED) A server issuing a command to a data distribution 
system in linkage with a display device including a receiving unit receiving data containing a 
motion picture from a data distribution system, a display unit displaying the motion picture, and a 
pointing unit pointing a position on the motion picture, said server comprising: 
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a communication unit receiving information on the position where the pointing 
manipulation is effected on the motion picture from said display device; 

a recognizing unit recognizing the object in the motion picture receiving the pointing 
manipulation on the basis of the information received from said display device; 

a referring unit referring to an instruction related to the object; and 

a commanding unit commanding said data distribution system to change over the data to 
be distributed in accordance with the instruction. 

39-60. (CANCELLED) 

61 . (CURRENTLY AMENDED) A storage medium readable by a machine, tangible 
embodying a program of instructions executable by the machine to control a display device 
including a display unit displaying a motion picture and a pointing unit pointing a position on the 
motion picture, comprising: 

recognizing an object in the motion picture on which the pointing manipulation is effected; 

and 

executing a predetermined process related to the object recognized, 

wherein said predetermined process involves, when the pointing manipulation occurs 
during the display of the motion picture contained in the first data, commanding said display 
device to output, after an end of displaying the motion picture, the second data related to the 
object recognized by the pointing manipulation. 

A storag e m e d i um r e adab le by a mach i n e tang i bl e e mbody i ng a program according to 
cla i m 60, wher e in said display device further includes a recording unit recording the data, and 

said predetermined process involves, when the object is recognized from the pointing 
manipulation during the display of the motion picture, commanding said recording unit to record 
the second data related to the object, and commanding said display device to output, after the 
end of displaying the motion picture, the second data recorded. 

62. (CANCELLED) 

63. (CANCELLED) 

64. (CURRENTLY AMENDED) A storage medium readable by a machine, tangible 
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embodying a program of instructions executable by the machine to control a display device 
including a display unit displaying a motion picture and a pointing unit pointing a position on the 
motion picture, comprising: 

recognizing an object in the motion picture on which the pointing manipulation is effected; 

and 

executing a predetermined process related to the object recognized, 
wherein said predetermined process involves, when the object is recognized from the 
pointing manipulation during the display of the motion picture contained in the first data, 
commanding said display device to effect a first changeover to an output of the second data 
related to the object, said predetermined process involves commanding said display device to 
execute a second changeover to displaying the motion picture after outputting the second data, 
and 

A storag e m e d i um r e adab le by a machin e tang i bl e e mbody i ng a program according to 
c l a i m 63, wh e r ei n said display device further includes a recording unit recording data, and 
said predetermined process involves issuing a command of displaying, after outputting the 
second data, the motion picture from a point of the first changeover recorded on said recording 
unit. 

65. (CANCELLED) 

66. (PREVIOUSLY PRESENTED) A storage medium readable by a machine, 
tangible embodying a program of instructions executable by the machine including a 
communication unit so as to control a display device including a display unit displaying a motion 
picture and a pointing unit pointing a position on the motion picture, to perform method steps 
comprising: 

transmitting the position on the motion picture receiving the pointing manipulation to a 
server including a recognizing unit recognizing an object in the motion picture receiving the 
pointing manipulation; 

receiving, from said server, information on the object in the motion picture recognized by 
said server; and 

executing a predetermined process related to the object recognized. 

67. (CURRENTLY AMENDED) A The storage medium readable by a machine 
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tangible embodying a program according to claim 66, wherein said display device further 
includes a receiving unit receiving data, 

said receiving unit receives first data containing the motion picture, and second data 
related to the object in the motion picture contained in the first data, and 

said predetermined process involves making said display device output the second data 
related to the object recognized. 

68. (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 67, wherein the second data contains an 
image related to the motion picture of the first data. 

69. (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 67, wherein the second data is multiplexed 
with the first data and thus distributed. 

70. (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 69, wherein the first data is constructed with a 
predetermined data structure and t he second data is embedded in a margin formed in the data 

71. (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 66, wherein the predetermined process is an 
execution of an application program related to the object recognized. 

72. (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 66, wherein the predetermined process is an 
execution of a task related to the object recognized. 

73. (CURRENTLY AMENDED) A- The storage medium readable by a machine 
tangible embodying a program according to claim 66, wherein said predetermined process 
involves commanding, via said communication unit, other task executing device to execute a 
task related to the object recognized. 
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74. (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 46, wherein said display device includes a 
reproducing unit reproducing the motion picture recorded on a recording medium, 

said recording medium is recorded with a first motion picture and a second image related 
to an object corresponding to the first motion picture, and 

said predetermined process involves reproducing from said recording medium the 
second image related to the object recognized and making said display device display the 
reproduced second image. 

75. (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 66, wherein said server further includes a unit 
transmitting the information to an add-up device adding up the pieces of information, and 

said predetermined process involves notifying said server of the information on the object 
recognized, and making said add-up device add up results of the recognition via said server. 

76. (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 66, further comprising reproducing the motion 
picture recorded on said recording medium, 

wherein said transmitting involves, when the motion picture to be reproduced receives 
the pointing manipulation, transmitting, to said server, information for specifying this motion 
picture and information for specifying a position where the pointing manipulation is effected on 
the motion picture. 

77. (CURRENTLY AMENDED) A storage medium readable by a machine, tangible 
embodying a program of instructions executable by the machine including a communication unit 
so as to operate in linkage with a display device including a receiving unit receiving data 
containing a motion picture, a display unit displaying the motion picture, and a pointing unit 
pointing a position on the motion picture, to perform method steps comprising: 

receiving information on the position where the pointing manipulation is effected from 
said display device; 

recognizing the object in the motion picture receiving the pointing manipulation on the 
basis of the information received from said display device; and 

executing a predetermined process related to the object recognized. 
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78. (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 77, wherein said predetermined process 
further includes transmitting an information on the object recognized to said display device. 

79. (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 77, wherein the predetermined process is an 
execution of a task related to the object recognized. 

80. (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 77, wherein said predetermined process 
involves commanding other task executing device to execute a task related to the object 
recognized via said communication unit. 

81 . (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 77, wherein said predetermined process 
involves notifying an add-up server for adding up pieces of information, of the information on the 
object recognized, and making said add-up server add up results of the recognition. 

82. (CURRENTLY AMENDED) A -The storage medium readable by a machine 
tangible embodying a program according to claim 77, wherein said communication unit 
communicates with an E-mail server delivering an E-mail, and 

said predetermined process involves commanding said E-mail server to deliver an E-mail 
related to the object recognized via said communication unit. 

83. (CURRENTLY AMENDED) A storage medium readable by a machine, tangible 
embodying a program of instructions executable by the machine including a communication unit 
so as to issue a command to a data distribution system in linkage with a display device including 
a receiving unit receiving data containing a motion picture from said data distribution system, a 
display unit displaying the motion picture and a pointing unit pointing a position on the motion 
picture, to perform method steps comprising: 

receiving information on the position where the pointing manipulation is effected on the 
motion picture; 
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recognizing the object in the motion picture receiving the pointing manipulation on the 
basis of the information received from said display device; 
referring to an instruction related to the object; and 

commanding said data distribution system to change over the data to be distributed in 
accordance with the instruction. 

84-108. (CANCELLED) 

1 09. (CURRENTLY AMENDED) A control method of controlling a display device 
including a display unit displaying a motion picture and a pointing unit pointing a position on the 
motion picture, said method comprising: 

recognizing an object in the motion picture on which the pointing manipulation is effected; 

and 

executing a predetermined process related to the object recognized, 
wherein said predetermined process involves, when the object is recognized from the 
pointing manipulation during the display of the motion picture contained in the first data, 
commanding said display device to effect a first changeover to an output of the second data 
related to the object. 

said predetermined processing involves commanding said display device to execute a 
second changeover to displaying the motion picture after outputting the second data, and 

A contro l m e thod aooord i ng to c l a i m 108, wh e r ei n said display device further includes a 
recording unit recording data, and said predetermined processing step-involves issuing a 
command of displaying the motion picture from a point of the first change over recorded on said 
recording unit after outputting the second data. 

110. (CANCELLED) 

111. (PREVIOUSLY PRESENTED) A control method of controlling a display device 
including a display unit displaying a motion picture and a pointing unit pointing a position on the 
motion picture, said method comprising: 

transmitting the position on the motion picture receiving the pointing manipulation to a 
server including a recognizing unit recognizing an object in the motion picture receiving the 
pointing manipulation; 
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receiving, from said server, information on the object in the motion picture recognized by 
said server; and 

executing a predetermined process related to the object recognized . 

112. (CURRENTLY AMENDED) A -The control method according to claim 111 , wherein 
said display device further includes a receiving unit receiving data, 

said receiving unit receives first data containing the motion picture, and second data 
related to the object in the motion picture contained in the first data, and 

said predetermined process involves making said display device output the second data 
related to the object recognized. 

113. (CURRENTLY AMENDED) ArThe control method according to claim 112, 
wherein the second data contains an image related to the motion picture of the first data. 

114. (CURRENTLY AMENDED) A-The control method according to claim 112, 
wherein the second data is multiplexed with the first data and thus distributed. 

115. (CURRENTLY AMENDED) A-The control method according to claim 114, 
wherein the first data is constructed with a predetermined data structure and the second data is 
embedded in a margin formed in the data structure of th e first data . 

116. (CURRENTLY AMENDED) A -The control method according to claim 111, wherein 
the predetermined process is an execution of an application program related to the object 
recognized. 

117. (CURRENTLY AMENDED) A -The control method according to claim 111, wherein 
the predetermined process is an execution of a task related to the object recognized. 

118. (CURRENTLY AMENDED) A-The control method according to claim 111 , 
wherein said 

predetermined process involves commanding, via said communication unit, other task 
executing device to execute a task related to the object recognized ; 
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119. (CANCELLED) 

120. (CURRENTLY AMENDED) A -The control method according to claim 111, wherein 
said server further includes a unit transmitting the information to an add-up device for adding up 
the pieces of information, and 

said predetermined process involves notifying said server of the information on the object 
recognized, and making said add-up device add up results of the recognition via said server. 

121. (CURRENTLY AMENDED) A-The control method according to claim 111, further 
comprising reproducing the motion picture recorded on recording medium, 

wherein said transmitting involves, when the motion picture to be reproduced receives 
the pointing manipulation, transmitting, to said server, information for specifying this motion 
picture and information for specifying a position where the pointing manipulation is effected on 
the motion picture. 

122. (PREVIOUSLY PRESENTED) An information processing method for a computer 
including a communication unit to operate in linkage with a display device including a receiving 
unit receiving data containing a motion picture, a display unit displaying the motion picture, and a 
pointing unit pointing a position on the motion picture, said method comprising: 

receiving information on the position where the pointing manipulation is effected from 
said display device; 

recognizing the object in the motion picture receiving the pointing manipulation on the 
basis of the information received from said display device; and 

executing a predetermined process related to the object recognized . 

123. (CURRENTLY AMENDED) Af hThe information processing method according to 
claim 122, wherein said predetermined process further includes transmitting an information on 
the object recognized to said display device. 

124. (CURRENTLY AMENDED) An -The information processing method according to 
claim 122 , wherein the predetermined process is an execution of a task related to the object 
recognized. 
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125. (CURRENTLY AMENDED) An -The information processing method according to 
claim 122, wherein said predetermined process involves commanding, via said communication 
unit, other task executing device to execute the task related to the object recognized. 

126. (CURRENTLY AMENDED) An -The information processing method according to 
claim 122, wherein said predetermined process involves notifying a ad-up server adding up 
pieces of information, of the information on the object recognized, and making said add-up 
server add up results of the recognition. 

127. (CURRENTLY AMENDED) An -The information processing method according to 
claim 122, wherein said communication unit communicates with an E-mail server delivering an 
E-mail, and 

said predetermined process involves commanding said E-mail server to deliver an E-mail 
related to the object recognized via said communication unit. 

128. (CURRENTLY AMENDED) An information processing method for a computer 
including a communication unit to issue a command to a data distribution system in linkage with 
a display device including a receiving unit receiving data containing a motion picture from said 
data distribution system, a display unit displaying the motion picture and a pointing unit pointing 
a position on the motion picture, said method comprising: 

receiving information on the position where the pointing manipulation is effected on the 
motion picture; 

recognizing the object in the motion picture receiving the pointing manipulation on the 
basis of the information received from said display device; 
referring to an instruction related to the object; and 

commanding said data distribution system to change over the data to be distributed in 
accordance with the instruction. 

129-135. (CANCELLED) 
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